PHLY-25,356 
1 of 15 



ADVERTISER 
DATA INPUT 

~~T~ 



AUDIO MODULATE 



-100 
-102 



101 



108 



117 



TV PROGRAM 
SOURCE . 

1 

104 




106 



> 110 ^^^^ 

109-1 C V 

AUDIO 



107 L 



RECEIVER 



FIG. 1 



\our 

113 
116- 



109- 



110 



RECEIVER 



FIG. 2 



TO 
NETWORK 



204 



1 DISPLAY 




118 

114 

/ 






1 PC 




MODEM 








112 i 


PROGRAM 
INFORMATION 


TO 
NETWORK 



SOUND 


^206 


CPU 






ADVERTISER 
WEB PAGE 

212 


CARD 




MODEM 






^208 


o o 



DISPLAY 



118 




I ADVERTISER I 

I DATABASE ' 
I J 



PHLY-25,356 
2 of 15 



PATH A: SOURCE TO ARS 


400-^ 


URL OF 
ARS 


ADVERTISER 
PRODUCT CODE 


URL OF 
SOURCE 


FIG. 4 a 

PATH B: ARS TO SOURCE 


402-^ 


URL OF 
SOURCE 


URL OF 
ADVERTISER 


URL OF 
ARS 


FIG. 4b 

PATH C: SOURCE TO ADVERTISER 


jy 404->^ 


URL OF 
ADVERTISER 


REQUEST-FOR- 
INFORMATION 


URL OF 
SOURCE 


r 

yd 

f J PATH D: 


FIG. 4c 

ADVERTISER TO SOURCE 


406-^ 

fl 


URL OF 
SOURCE 


REQUESTED 
INFORMATION 


URL OF 
ADVERTISER 


ru 

□ PATH E: 


FIG. 4d 

ARS TO ADVERTISER (OPTIONAL) 


" 408-^ 


URL OF 
ADVERTISER 


REQUEST-FOR- 
INFORMATION 


URL OF 
SOURCE 


FIG. 4e 



602- 
604- 



( START ) 




DECODE PACKET 



EXTRACT PRODUCT CODE 



LOOKUP URL OF 

ADVERTISER 
BASED ON CODE 

i 



ASSEMBLE PACKET 



FIG. 6 



SEND TO SOURCE 
(PATH B) 



■606 



■608 



■610 



PHLY-25,356 
3 of 15 



( START ) 



'SIGNAL LEADER\ N 
DETECTED? 

502 



DECODE THE 
FOLLOWING DATA 



BUFFER THE DATA 



504 ^ 506 
DATA 

^authenticated: 

9 



LAUNCH WEB BROWSER 



INSERT URL DATA 
INTO WEB BROWSER 



SEND URL TO 
GLOBAL NETWORK 



ARS SERVER RESPONDS 
WITH URL OF 
ADVERTISER SERVER 



PC TRANSMITS REQUEST 
FOR PRODUCT INFORMATION 
TO ADVERTISER SERVER 



ADVERTISER SERVER 

SENDS PRODUCT 
INFORMATION TO PC 



C START ) 



RECEIVE ARS PACKET 



522 

_z_ 



SIGNAL FOR 
RETRANSMISSION 



I 



EXTRACT URL OF 
ADVERTISER PRODUCT 
INFORMATION 



DISCARD 



■508 



-510 



-512 



-514 



-516 



■518 



520 



SEND MESSAGE TO 

ADVERTISER 
SERVE R (PATH C) 

i 



WAIT 



-700 



-702 



-704 



-706 



& 



RECEIVE SOURCE 
PACKET 



EXTRACT PRODUCT 
INFORMATION 
FILE LOCATION 

i 



TRANSMIT PRODUCT 
INFORMATION TO 
SOURCE (PATH D) 



•708 



-710 



■712 



ADVERTISER 
SERVER 



RETURN 



PROCESS ADVERTISER 
INFORMATION 



-714 
■716 



800- 



808 



PHLY-25,356 
4 of 15 



DISPLAY 



804 BROWSER PAGE 
\ 806 



http://URL[/?][ADVERTISER DATA] 



802 



O O 



FIG. 8 



URL/ADVERTISER DATA 



[Ctrl-0] [http://] [URL] [/?] [variable] [ J ] 



OPEN PAGE 

USE HYPERTEXT PROTOCOL- 
URL OF ARS: 



ALLOW VARIABLE APPENDING 

APPENDED VARIABLE (e.g., UPC CODE)- 
CARRIAGE RETURN - TRANSMIT DATA- 



902 
\ 

VIDEO 

O D 



904 -^(ROUTING 
INFORMATION) 



901 
AUDIO / . 



906 

s 


910 

/ 


912 

/ 


PC 




NET 




REMOTE 






INFORMATION 



USER 



■908 



FIG. 9 



PHLY-25,356 
5 of 15 



902- 



VIOEO 



901 

/ AUDIO 



904 -N. (ROUTING 
INFORMATION) 



FIG. 10 



908- 



1002 



PC 



USER 



910 



NET 



REMOTE 
INFORMATION 



912 



1004 
_Z_ 



PC 



DATABASE 



-1006 



VIDEO SOURCE 



1204 



OPTICAL REGION 




m 





r 

902 



1202 



SENSED VIDEO 



FIG. 12 



906 



PC 



PRIMARY ROUTING 
INFORMATION 


FIG. 11 








PRIMARY ROUTING 
INFORMATION 


SECONDARY ROUTING 
INFORMATION 


910 

/ 


912 

/ 



NET 



908- 



USER 



902 1302- 



VIDEO 













PROFILE 
DATABASE 






ID 


^1304 


1 




1 


910 
S 



904 -x. (ROUTING 



901 

/ AUDIO 



'906- 
908- 



PC 










USER 





FIG. 13 

310- 



INTERMEDIATE 
DESTINATION 
^ TABLES ^ 



REMOTE 
INFORMATION 




I 



PHLY-25.356 
6 of 15 



( START V -1402 



PROMPT FOR PROFILE 




•1404 



1408 



1502- ^ START ) 
1504 



ENTER BASIC 
INFORMATION 



ENTER SPECIFIC 
INFORMATION. JOBS. 

INCOME. HISTORY. 
DEMOGRAPHICS. ETC. 



STORE LOCALLY 



1414 




•1412 



1415 



1506- 



1508- 



1510- 




RX PRIMARY ROUTING 
INFORMATION 
AND USER ID 



LOOKUP MANUFACTURER'S 
URL AND RETURN 



UPDATE TRANSACTION 

DATABASE FOR 
CURRENT TRANSACTION 



SET FOR LATER 



START CONNECT PROCESS 



1418 





1420 



SET FOR 

LATER 
DELIVERY 



Y |Y 
1422-<i^0R3 



--1520 
1516-- 



FORWARD TO 
MANUFACTURER 



UPDATE 
BILLING 



SEND PROFILE 
INFORMATION WITH 10 



I 



TERMINATE 
AND ACTIVATE 



•1428 



■1430 



FIG. 15 



C2^L>-1432 

FIG. 1 4 



PHLY-25,356 
7 of 15 




PHLY-25,356 
8 of 15 



1906 




FIG, 20 




PHLY-25,356 
9 of 15 



2102 

==A= 



FIG. 21 



2104 



2106 

==A= 



ARS DATABASE 
2100 



2108 



BAR CODE 


ROUTE 


10 


DISTRIBUTOR 


PROFILE 


BAR CODE 


INFORMATION 

















2202- 



2204- 



2208- 

2210- 
2212- 



FIG. 22 

CUSER^ 



2200 




ASSEMBLE BAR CODE, 
\<A ID. ARS URL AND 
LAUNCH BROWSER 



WINDOW PARTITIONED INTO 
THREE FRAMES; KA ID. 
BAR CODE AND E-COMMERCE 




2206 



ROUTE INFORMATION 
FOR EACH WINDOW 



RECEIVE INFORMATION 
FROM ROUTED-TO SITES 



PLACE IN ASSIGNED FRAME 



CenT^ 



PHLY-25.356 
10of 15 



2302- 
2304- 



2308- 



2312- 



2314- 



FIG. 23 




WATCH TO MFC 



ASSEMBLE BAR CODE 
ROUTING STRING 



2306 




ASSEMBLE KA 10 
ROUTING STRING 



E-COMMERCE?^ 



2310 



PROCESS AND . 
ASSEMBLE E-COMMERCE 
ROUTING STRING 



■ RETURN ALL 
ROUTING STRINGS 



2404 



FIG. 24 

CE-COMMERCf) 



RECEIVE MESSAGE PACKET 




MATCH BAR CODE 
WITH 1 D 



I 



LOOKUP E-COMMERCE 
ACTION 



I 



ASSEMBLE MESSAGE PACKET 

WITH E-COMMERCE 
INFORMATION AND ROUTING 
INFORMATION (BAR CODE 
CONTENT AND/OR 
USER PROFILE) 



I 



JRANSMIT TO USER PC 

I 



( RETURN ) 



2400 



•2406 
2408 



2410 



2412 



6. 



PHLY-25,356 
12of 15 




PHLY-25,356 
13of 15 



1 

# 

I 



A. 



1 



£3 



m 



UTiD -fro PC 



■iPi 



ii 



PC i?^iy.:i<?.^1l3^<^S 




AS 





HaScL. UCs ^ uriD w/ a 





FIG. 2.a 



PHLY-25,356 
14 of 15 




) 



/ 


/ 


2^04- 
/ 




uc 






UTI O 


urrD 











PHLY-25,356 
15 of 15 




